OOCOHENT BESOHE 



ED 1U2 640 



DD 017 143 



AOTHOR 
TITLE 

INSTITOTION 

POB DATS 
NOTE 



EDES PRICE 
DESCRIPTORS 



IDENTIFIERS 



Silverstein, Leonard 

Project Turnabout, School Year 1975-1976. 

New York City Board of Education, Brooklyn, N.Y. 

Office of Educational Evaluation. ^ 

'^^ .1 
mp. ; New York City Board of Education Functiop No. 

20-63403 \ 
HF-$0.83 HC-$1.67 Plus Postage. 

♦Elementary Education; Grade 4; Grade 5; Grade 6; 
♦Instructional Aids; ♦Programed Instruction; ♦Program 
Evaluation; Public Libraries; ♦Remedial Reading; 
School Libraries ; 
New York (New York) ; Umbrella Projects 



ABSTRACT 

Students in this remedial reading program were given 
a chance to "turnabout" through the use of innovative materials and 
methods used in the program. Remedial instruction in reading and all 
the language arts was provided. The program utilized three 
paraprofessionals. The Random House High Intensity Training System 
was used with 180 fourth through sixth grade students selected to 
participate in the program because they were at least six months 
below grade level in reading. The Metropolitan Achievement Test was 
administered during the first and last week of the program as a 
diagnostic and assessment instrument. This evaluation report 
concluded that students in the program increased their reading 
performance as measured by the Metropolitan Achievement Test. Also, 
students used library resources more than they had the previous year 
and expressed favorable attitudes toward the program staff. The 
reading attitude assessment scale used for the evaluation is included 
as an appendix. (Author/JP) 



******************************************************** 

♦ Documents acquired by ERIC include many informal unpublished ♦ 

♦ materials not available from other spurces. ERIC makes every effort ♦ 

♦ to obtain the best copy available. Nevertheless, items of marginal ♦ 

♦ reproducibility are often encountered and this affects the guality ♦ 

♦ of the microfiche and hardcopy reproductions ERIC makes available ♦ 

♦ via the ERIC Document Reproduction Service (EDRS) . EDRS is not * 

♦ responsible for the quality of the original document. Reproductions ♦ 

♦ supplied by EDRS are the best that can be made from the original. ♦ 
*******************************************♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦*♦♦♦♦♦♦♦♦ 



ERIC 



EVALUATION REPOEII 



Function No. Bii// 20-63^^03 



PROJECT TURNABOUT 
SCHOOL YEAR 1975 - 1976 

PREPARED BY I 

LEONARD SILVERSTEIN,Ph.D. 



U S DEPARTMENTOF HEALTH. 
EDUCATION! WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 

THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIGIN- 
ATINGIT POINTS OF VIEWOR OPINIONS 
STATED DO NOT NECESSARILY REPRE- 
SENT OF^^CIAL NATIONAL INSTITUTE or 
EDUCATIOT^POSITION OR POLICY 



An Evaluation of Selected IX^fYoxk City Umbrella Programs 
funded under a Special Grantnof the New York State 
Legislature performed^^^jEP^ Board of Education of the 
City of New York for ^thrT975-1976 school year 



JUNE 1976 



DR. AllTHOtrY J. POLEMINI, DIRECTOZ 




aCARO QF EDCCATiaN OF THE C|TY OF MCW YORK 
OFFICE OF EDUCATIONAL EVALUATfON 
no UVINGSTON STREET^ BRaQKLYN, N. Y. tt201 



J 

TABLE OF CONTENTS 

Chapte ' No. Page No. 

I THE PROGRAM 1-2 

II- EVALUATION PROCEDURES, 2-3 

III FINDINGS 3-6 

IV • SU^mRY OF MAJOR FINDINGS, 

CONCLUSIONS, AND RECOMMENDATIONS ,6-? 

V APPENDIX ^ 
TABLE I: SUMMARY-READING ATTITUDE 

ASSESSMENT SCALE 8-9 

TABLE 2 I TASK INVENTORY RATINGS 10-11 

\ 



ERIC 



3 



.OJECI "TU){NABOUT 



Chapter It THE PRQGRAP^ 

This program was designed to meet the remedial reading rieeds 
of children in ir^.S. 107, Flushing, Queens, (District 2^). Remed- 
ial instruction in reading and all language arts was provided. 
The progran utilized three paraprofessionals who administered 
the Random House iigh Intensity Training System (HILS). These 
paraprofessionals serviced the children in grades 4-6, approxima1:ely 
180 children who vere at ieast 6 months below grade in reading. 
Additionally, the licensed teacher worked with paraprof essiooal 
staff to develop .ndividualized programs for heterogeneously 
grouped classes. The balance of the remediation effort ivas to 
be sFviit in assisting the school librarian in the media center 
( li brary ) • 

The reading activities consisted of administering the Met- 
ropolitan Achieve;fient Test during the first week of the program, 
and the last week. This test was used as an evaluative tool as 
well as a preliminary diagnosis of individual learning Droblams. 
Upon entering the program the student;? were given six to ten 
check-in tests and prescriptions were selected for those areas 
where the student scored 50%-80%. The Catalogue described each 
instructional objective and lists prescript';.ons for each student. 
The prescriptions vere drawn from S.R.A., Singer, Random House, 
Word PacGi's, as well as other basal materials as needed- Each 
student worked on his prescription and was provided direct 
individual instruction when necessary • Then each student took 
a check-out test to determine the extent to which he achieved 
the unit instructional objective. The results were recorded 
in the student work book. Subsequently, new individualized pre- 
scriptions were developed. 

This program sought to meet the needs of those students who 
belong in individualized classroons and also traditional class- 
rooms. This was done by remediation in self-contained, traditional 
classrooms and individualized instruction in the individualized 
classroom. 

It was intended to give youngsters who have failed, or were 
failing with traditional approaches to reading, a chance to 
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"Turruibout*^ by usi.ng new materials; (High Intensity Learning 
System) an-i a more; meaningful appi^oach (Individualized Pro- 
gramm..ng), , . . 

iill s ^th grade students chosen for the program ^^e ^ selected 
becauiie tb y were at least six mor.ths below grade level • Approx- 
imately ont half of the fourth and fifth grade students were 
also s;ix m ^athti behind in reading. The other half were at or 
slighi.ly b low their grade level. These students were targeted 
because it \ms felt that many of them would end up further behind 
by the tim»^ they reached the sixth grade. 

Disse-dnation of information about the program was to take 
place at pirent-pr incipal "coffee hours" and P.T.A. meetings. 

I he p: -:gram began 10/1V75- The pretest was administered 
11/2 V76 aivi the post-test was performed 5/30/76. The program 
terminated 6/30/76* 

Chapter li s EVALUATION PROCEDURES 

Evaluation Objective #lt To determine whether, as a result 
of participation in the "Turnabout" reading program, the reading 
grade of tae students will show a statistically significant diff- 
erence between the real post-test score and the anticipated post- 
test score using the Metropolitan Achievement Test (MAT) as a 
performance measure. 

. 1.1 Subjects: All ^-6 gractes in the program. 

1.2 Methods and Procedures: The appropiate level of the 
MAT will be administer^'d twice; tne first week of pro- 
gram, and again during the last week of the program. 

1.3 Analysis of Data: Data will be analyzed by the "re) 
(treatment) post-test vs. anticipated (without treat- 
ment) post-test" design using the historic^ .regression 
rate adjusted for the term of the program*iH| 

E valuation Objective 2i Sixty per cent of the participants 
in the program who attended severity five per cent of the program 
sessions would use library materials to a greater degree Jhan 
previous . 

Tliis objective was measured by school library records and 



teache]* observation. In addition, a Pupil Reading Attitude 
Assessnentl Scale was developed which used student self report 
as an : nd/x of achievement in this area (See Appendix, ^able 1, 
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question ^) • 

Optional Evaluation ub.iective # 3i Student attitudes towards 
reading, staff and program elements were raeaeured. There were 
1^8 children who completed the Reading Attitude Assessment Scale 
(See Appendix, Table 1). 

Optional Evaluation Objective ft An additional s.dministra- 
tive objective was analyzed as an optional concept. Namely, 
the adequacy of the paraprof essional educational assistants in 
performing the primary tasks necessary for the High Intensity . 
Learning System. 

Educational assistant staff rated primary te.sks (See 

Appendix, Table 2 )^ They rated their jobs on three dimensions i 
A. Knowledge Importance C Their Own Ability. A five point 
rating scale was used, (See Appendix, Table 2) with four as the 
highest level and zero as the lowest score. All educational 
assistants (3) completed the ratings. 
Chapter Illt FIND.INGS 

Project Qbje(!tive ft 1» 80% of those participants in the 
program attending 75i^ or more of the progi'am sessions will make 
significant gain tn reading achievement above their normal ant- 
icipated rate as neasured by the administration of the 19" 5 
Metropolitan Achievement Test as a post-test. 

The pretest was administered 11/2^/75 "to 172 children and 
posttest was given 5/26776 to 163 children. Nine children 
transfered to othtir schools, which meant that every child who 
began the program and remained enrolled in the school received 
uhe posttest. 



TABLE I 

Historical Regression Design (Grades 4-6} 







Test 
Used 


Total 

N 


P 


retest 


Predicted . 
Posttest Mean 


Actual Posttest 


D?ite 


Mean 


Date 


Mean 


MA.T ^ 


163 


11/2^ 


^.01 




5/30 







Statistical Data 

obtained value of t * 2.25 

level of significance, p<. 025 



kil car be seen in Table I the: 
nificant ir crease for the 163 stud( 
These results obtained even though 
materifls arrived February 1, 1976 
processing a proposal modification, 
assistants conducted remedial sess: 

The period between February 1. 
nessed the arrival of additional r< 
The full resources of the program \ 
entire schcol year. Nevertheless, 
were eJ'fecluated, .see Table II bel« 

TABLE 

Reading Change in Mon 



Months 



^8 to 

to. 0 

1 to ^ 

^ to q 



Frequency 



33 
52 



e was a statistically sig- 
nts enrolled in the program, 
the new High Intensity 
due to the necessity for 

However, the educational 
ons in the interim. 

1976 and June 30, 1976 wit- 
ading resource • materials • 
ere not available for tht- 
the following reading changes 
w for grades ^-6« 
II 

.hs (based on IWAT) ' 



Months 



10 to 1^ 

15 to 19 
20 to 2^' 
25 or more 



Freq uency 



22 

6 

0 
2 



Based on the IVIAT, ^5:^ of the : tudents increased their reading 
level one year or more. Two studerits gained in excess of two 
and a half years. For 23^ of the students there was no gain or 
a loss in reading performance. It was hypothesized that one of 
the factors that could contribute to such a loss would be 
school attendance 0 This factor was analyzed but no correlation 
with reading scores was obtained. Further speculation as to 
the possible cause of reading decrements must await, the gathering 
of information f5)i* specific psychological, . social and economic 
factors . 

i^o.iect Objective # 2> 60% of those participants in the 
program attending 75yo or more of the program sessions will 
utilize materials to a greater degree than previous to the in- 
ception of the program as measured by library records kept by 
the school and by the observations of the teachers. 

This objective was not entirely met since the school multi- 
media center was not in operation for the 1975-76 school year. 
However, the educational assistants did go to each classroom with 



library materials although no elaborate documentation wa, > kept. 

Optional Project Objective // j i The measurement of student 
attitudes towards reading as a consequence of participat uon in 
in 1:^0 ject "Turnabout." 

The pupil response to the attitude assessment scale indi- 
cated that they perceived the program and staff as fair, con- 
cerned and providing a team approach. The group who had the 
worst expr(»ssed attitude, namely "ethers were always goofing", 
had receivtjd a new classroom teacher midway through the program. 
An examina:ion of the class reading scores indicated that this 
group also had the smallest increase of any class in the program. 
The survey showed that negative attitudes toward reading were 
related to performance. However, whether this was an adjust- 
ment reaction to a new teacher or the result of other variables 
has not tean determined. Some students expressed generally 
negative attitudes, however, names were not required for the 
survey in ':;he interests of honesty, so only class generalizations 
were possible. It does point up t^e need to overcome some 
pupil orieiitations which are highly negative. Other kinds of 
intervenTiion may be more productive with this group than reading 
alone. 

Optional Projent Ohjpnt rve ;/ A self -evaluative instru- 
ment was administered to judge the adequacy of educational staff 
assistants. This was a job analysis developed by the evaluatoro 
The task inventory methodology revealed that most aspects of the 
program were carried out as designed. However, the use of 
the wall-crxart had been eliminated. This was due to the feeling 
on the part of the staff that it would result in undesireable 
levels of competitiveness. The deidgners of the program view 
it as another form of feedback (motiv^ation) that progress was 
made in instructional objectives. This wall-chart recording as 
well as recording results in the student workbook was regarded 
as a clerical function, therefore not so very important. 

The task of goin/; to classroon library and observe students 
ms only performed by two para prof essionals . This v/as prob- 
aMy due to the fact that one of tlie staff had resigned in the 
m: dst of the program and an attempt to learn the intricacies of 
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the Hi],s was given first priority, 

ne taak analysis revealed that the educational assistant 
of iTo;ec:t "Turnabout" dealt with teachers only. The classroom 
teachers worked with paronty.ih order to provide a more balanced 
view oi the pupils. 

il ysical Facilities! The snaU tables^ and movable chaiis ■ 
which ^5re provided seemed adequate to the^task of small group 
instruction and individualization cf the program. Interest 
areas fir tape recorders and other multi-media material centers 
vere alio in evidence. The- space alloted per pupil was adequate. 

In 'ormation Dissemins tion » Information concerning the 
program was disseminated ly the principal at coffee hours with 
the partnts, which th3 evaluator attended. This provided a worth- 
while, informal means of accquainting concerned parents with 
innovative concepts in reading remediation and should be con- 
tinued . 

Chapter SUMMARY OF MAJOR FINDINGS. CONCLUSIONS. AND 

R ECOMMENDATION S 

Summary t 

Pro.iect Ob.^active ^ 1 i There was a statistically significant 
increase in reading performance as measured by the i etropolitan 
/chievemmt Teat. 

jrciect ob.iective # 2» Over SOYo of these students reported an 
increase in public library usuage over the previous year, using 
a self n.'port measure. The multi-media center (school library) 
was not opened during the school year so this objective was 
net by educational assistant staff, who went to each class- 
room with supplemental materials 

.Optional Pro.iect O b.iective # 3> The expressed attitude of the 
students towards the program, materials and staff was highly 
fivorabLj. Teaching by instructional objective, small group 
iistruction and one to one instruction created a team approach 
a -.mosphei.^e . There were students who did not, however, share this 
mere general viewpoint. 

Oj)tior^l Objective 4i The task inventory methodcOogy revealed 
tliat the High Intensity Learning System was implemented as 
designed except for wall-chart recording. Not all materials 
were available for the entire length of the program. The 
program was evaluated from October 1975 to June 1976. 
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nnnriijfijnns ; Basecl on the methodology employed, t aere was a 
significant change in student me^.sure i perf ornuince in reading. 
Para prof es si ma 1 staff provided g, higrily effective, quality pro- 
gram for St t ients in grade ^-6 wlio we e below ieve3. in read ing. 
Students eX:?ressed attitudes toward t e program, maiteri.?.!., and 
staff were dghly favorable. 

The majority of the students res] onding to t ie ?}:xitude 
questionnai -e described themselv6 s as being more confident in 
learning re iding skills and more able in using the public library 
(See Appendix, Tabl » 1). 
Recommendat Ions : 

1. An ongoing evaluation system which would seek to identify 
the lower 2 3?^ of tho students whc were not benefiting from the 
program. This woul i mean approximately forty students would 
have to receive some additional service. The nature of this 
service is indeterminate at this time, but should be directed 
at individual needs, in keejr>ing v\ith the program philosophy. 

2. The notion of early intervention as an important factor 
in learning suggest s that lower grade children be included in 
the program. It is recommended that the HILS system be ex- 
tended to secMid an<i third grade pupils. 

3. Every effort -lUSt be made io operate the multi-media 
center (li: rary) for the next school year as an integral part 
of the pro^ ram. 

Cont. nue principal/parent coffee hours as a means of 
disseminating information concerning this program. 

5. The arget population of*below reading grade children 

be extender to include all sixth g^ade students who might bene- 
fit from a reading enrichment program. 

6. Although the materials- used were adequate, appropiate 
money to obtain all materials covered by HILS. 

7. Although the space allotted was adequate, more 
specialized interest centers and audio-visual materials may 
increase student n»)eds for additional space. 

8. This program should be continued since the late funding 
and arrival of mat'?rial suggests that the technology employed 
may be even more favorable wljen used for an entire school year. 



1.0 



-8- 



APPENDIX 



Table 1: Sunmary of Reading Attitude Assessment Scale, Completed 
By m^Q Stuaeits in Project "Turnabout". 

Note: Frequencies of response are summated in ptirenthesis (f) 
above each scale designation. 



1. How much do you think your teachers care about your reading 

OBJ (99) 



problems and needs? 



T 
1 



completely 
uncaring 



2 

sometimes 
caring; 



3 

caring 



quite 
caring 



extremely 
caring 



2. In terms of time and attention which teachers devote to the 
students of the special reading program, do you receive? 



1^ 



much less 
than your 
fair share 



somewiiat 
less than 
your fair 
share 



your fair 
share 



somewhat 
more ttian 
yo>-ir fair 
sh'ire 



much more 
than your 
fair share 



3. How much intrest do you have in "taking your medicine" 
prescribed by the teachers of the special reading program? 



(11) 
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no interest 



very little 
interest 



some 

interest 



very 

interested 



extremely 
interested 



4. As a re&ult of being in the reading program do you feel more 
or less able to use the library? (We mean the public library, 
since the school library is closed.) 

(]0) Lfl)^ 



161 



1121 



much less 



somewhat 
less 



about the 
same 



somewhat 
more 



1 



not goofing 



very little 
goofing 



11 



fair amount 
of goofing 



a great 
deal of 
goofing 



5 

much 
more 



5. How much do you feel other students are "goofing off" in 
taking responsibility for their reading improvement? 

( ^0) 09) {9} 



always 
goofing 



Appendix "^^ 
Table 1 Continued: 

6. Hov/ much confidence do you have in your at Llity to learn new 
reading skills? 

(2) (6) (30) (64) 

-I 1 1 ] T 

12 3 -^5 

No confidence very little some .Tiuch totally 

coni idence confidence confidence confident 

7# How much more time are you spendirig readii g newspapers, books, 

magazines, ftc. this school year than last? 

ill Ul) LpJ _1^:2J (|^} 

1 \ 3 5 5 

none somewhat about the somewhat much 

less same time more more time 

8. Do you 3^eel free to discuss reading done at school with 
most people (friends, parents, relatives)? 

very somewhat comfortable very extremely 

uncomfortable uncomfortable comfortable comfortable 

9. How are you doing in reading compared with how you are doing 
with your other subjects? 

qi ij^ ^ 

poorer ?3omewhat same better far 

worse superior 



10. Do you feel there is team work between you and the teachers 
in the reading program? 

(12) (13) (35) (35) iW_ 

1 A p 

12 3^5 

no team very little some a great the 

work teamwork deal most 



A. What do you like most about reading in the Resource Room? 

The most usual response was one of the workbooks or other 
materials* 

B« What do you like least about reading in the Resource Room? 
The checl^ in and check out tests. 
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Table 2; Task Inventory Rating Scale 

A. Kjiowlec.ge State mentc 

^- A thorough and detailed knowledge of this is required to 
do my job. 

3- Some degree of specialized knowledge required- 

2d- Only a general knowledge of functional relations, is re- 
quired. 

1- Some familisrity is probably desired but not i-equired.* 

0- This is not required for ny job. 

B. Task Statements 

4- Absolutely necessary part of my job» 
3- /ery important part of my job. 

2- Jesireable but not critically important that I do this. 

1- Slight importance to do tliis. 

0- ,^ot a part of my job. 

G. Self Ratin^g; of Task Capability 
^- L nan do this as well as anyone. 

3- C have something to learn* 

2- [ am lairly proficient. 

1- [ am below average proficiency on this* 
0- 1 am aot equipped to perform this task. 

Task Inventory Ratings: Paraprof essional ratings based on 
A. Knowled^'-e B. Importance D. Their Own Ability 

1. Place ench student in program based on diagnostic testi 
Paraprofess ' .onal I Para professional 2 Para professional 3 

A. 4 4- unknown 

B. ^ k ^ 

C« ^ ^ unknown 

2. Give ea:h student check in test and select prescription! 

Paraprofessional 1 Paraprof essional 2 Pa raprof essional 3 

A. ^ * ^ ^' 

B. 4 k 4 

c. k 3 
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Append! : 

Table 2 continued ; 

3* Hec )rd rasults in student recorc form and wall chart: 

Pa ra pr o I 'e s s i onal I i^araprof essiona] 2 Paraprof essional 3 

k. i Z 2 

B* ? 2 2 

^4-* Tea ;h catalogue use for achieviiig instructional objective: 
i-'arapr o 'essipnal I Paraprof essiona. _J'^ Para-.prof ei;sional 3 
A. ^ ^ • . • 

C. ^ ' ^ 3 

5. Sel ict aad assign prescription e net follov^ up: 

Para pro ' essi o nal I Pa r a pr o i' e s s i o na ] 2 Paraprof es si onal 3 
A* ^ ^ ^-^ 
B* 1- ^ ^ 
C. ^ ^ 3 

6. Ciri:le prescription for student and provide instruction. 
para])ro Sessional I Paraprof essiona'.. 2 Paraprof essional 3 

A. '3 ^ ^ 

B. 4 ' 3 ^ 
C« I- ^ 

7* Admunister chetDk out test and record results: 

Para pr o r?essi onal I i ara pr of e s s i ona 3. 2 Paraprof essional 3 

Ac ) 3 -3 

B. 3 2 3 

C. 4 ^ ^ 

8. //he 1 student fails provide assisstance according to step 6* 
rarapro^'essional I Para professional 2 Paraprof essional 3 

A. I ^ 

B. f ^ ^ 

C. 4 ^ 3 

9# Go to classroom library and observe students: 

Para pre F essi onal_I l araprof essional 2 Paraprof essional 3 

A. + ^ unknown 

3. + k unknown 

C. + ' k ' unknown 

10. coordinate inrfS^^ridual programs with classroom teacher: 

i-araprof essional 1 Paraprof essional 2 Parapro f essiona. . 3 

A. 4 . ^ ^' 

B 4 4 4 

C. 4 4 ^ 
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